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VALUE  ADDED  ANALYSIS  EXPANDED  SOUTHWEST  ASIA  (QVEX) 

SUMMARY 


THE  PROJECT  PURPOSE  was  to  evaluate  the  costs  and  benefits  of  selected  weapon  systems 
and  to  develop  and  evaluate  alternative  weapon  systems  modernization  programs. 


THE  PROJECT  SPONSOR  is  the  Office  of  the  Deputy  Chief  of  Staff,  G8  (DAPR-FDA), 
Headquarters,  Department  of  the  Army. 


THE  PROJECT  OBJECTIVES  were  to: 

(1)  Detennine  the  marginal  effectiveness  of  selected  modernization  weapon  systems. 

(2)  Detennine  the  procurement  costs  of  the  modernized  systems. 

(3)  Develop  and  analyze  alternative  weapon  systems  modernization  programs. 


THE  SCOPE  OF  THE  PROJECT:  With  Training  and  Doctrine  Command  (TRADOC) 
approved  Southwest  Asia  (SWA)  8.0  scenario  using  Vector  in  Commander  (VIC)  corps  level 
combat  model,  determine  the  effectiveness  of  modernized  weapon  systems  as  these  systems 
compare  to  their  base  counterpart. 


THE  MAIN  ASSUMPTION 

(1)  Combat  simulations  are  an  appropriate  means  of  measuring  weapon  system  combat 
effectiveness. 

(2)  The  selected  Measures  of  Effectiveness  (MOE)  adequately  assess  the  combined  utility 
of  weapon  systems  under  consideration. 

(3)  The  TRADOC  SWA  scenario  is  appropriate  to  evaluate  the  weapon  systems  under 
consideration. 


THE  PRINCIPAL  LIMITATIONS  are: 

(1)  Not  all  procurement  programs  are  analyzed  because  of  the  limitations  of  the  corps 
combat  model. 


(2)  Deployability,  effects  of  training,  and  other  readiness  issues  are  not  modeled. 
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(3)  Cost  Module  does  not  include  Operation  and  Maintenance  cost. 


THE  PRINCIPAL  FINDINGS  are: 

(1)  The  primary  killer  on  the  battlefield  is  the  MLRS  firing  the  MSTAR  munition.  The 
MSTAR  munition  is  used  in  the  deep  fight.  The  close-in  fight  is  mainly  left  to  the  tanks,  which 
perform  admirably  by  eliminating  much  of  the  remaining  enemy  tank,  artillery,  helicopter,  and 
anti-tank  (TAHA)  systems. 

(2)  HIMARS  perfonns  significantly  better  than  the  Ml 98,  resulting  in  more  red  system 
kills  and  fewer  blue  system  losses. 

(3)  Modernizing  every  system  with  precision  munitions  does  not  always  have  a  synergistic 
effect,  especially  where  munition  ranges  overlap  and  there  is  a  limited  target  array.  Having  a 
balance  of  precision  and  non-precision  capabilities  results  in  more  enemy  kills  in  the  SWA 
scenario. 

THE  PROJECT  EFFORT  was  conducted  by  LTC  A1  East,  Resource  Analysis  Division,  Center 
for  Army  Analysis  (CAA) 

COMMENTS  AND  QUESTIONS  may  be  sent  to  the  Director,  Center  for  Army  Analysis, 
ATTN:  CSCA-RA,  6001  Goethals  Road,  Suite  102,  Fort  Belvoir,  VA  22060-5230 
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1  INTRODUCTION 


1.1  Value  Added  Analysis  -  QVEX 


Headquarters,  Department  of  the  Army  (HQDA),  requires  analysis  to  support  the  development  of 
a  balanced  and  effective  modernization  program.  The  Office  of  the  Deputy  Chief  of  Staff,  G8, 
Force  Development,  requested  this  project.  The  purpose  of  the  project  is  to  identify  and  analyze 
marginal  costs  and  benefits  of  weapon  systems  and  develop  feasible,  affordable  modernization 
investment  strategies  in  support  of  defense  reviews.  In  this  case  Value  Added  Analysis  (VAA) 
was  used  in  support  of  the  POM  (04-09).  VAA  analyzes  benefits  and  costs  among  different 
weapon  systems  and  munitions. 


1.2  Background 


This  simulation-modeling  study  used  the  Vector  in  Commander  (VIC)  model  (the  Anny’s 
principal  Corps-level  simulation).  VIC  is  a  two-sided  deterministic,  discrete-event  simulation  of 
combat  in  a  combined-arms  environment  representing  land  and  air  forces  at  the  U.S.  Army  corps 
level  with  a  commensurate  enemy  force  in  a  mid-intensity  battle.  The  model  has  variable 
resolution,  portrays  non-linear  warfare,  represents  all  air-land  battle  functions,  and  has  been 
verified  and  validated  by  U.S.  Army  Training  and  Doctrine  Command  (TRADOC)  schools  and 
centers.  The  model  is  designed  to  provide  a  balanced  representation  of  major  force  elements  in  a 
tactical  campaign  of  a  U.S.  Army  corps  operating  in  a  Theater  of  Operations. 

The  scenario  used  in  VIC  for  this  study  is  Southwest  Asia  Corps  and  Division  Scenario  8.0 
which  is  a  Defense  Planning  Guidance  compliant  scenario  set  in  February  2010.  It  is  the  second 
regional  conflict  and  depicts  a  Joint  Task  Force  (JTF)  containing  a  U.S.  Army  Airborne  Corps 
and  a  U.S.  Marine  Corps  Marine  Expeditionary  Force-Forward  (MEF-FWD)  supported  by  allied 
naval  and  air  forces.  The  JTF  is  deployed  following  a  persistent  chemical  strike  by  terrorists 
against  the  prepositioned  equipment  sets  and  after  the  other  prepositioned  equipment  set  afloat  is 
deployed  to  the  other  crisis.  The  airborne  corps  contains  an  air  assault  division  consisting  of  two 
air  assault  brigades,  division  artillery,  division  aviation,  and  division  support  command  and  one 
prepositioned  uncontaminated  armored  brigade.  Corps  troops  include  one  corps  FA  brigade  and 
an  attack  AH-64D  helicopter  battalion.  The  JTF  defends  against  a  threat  attack  eleven  hours 
after  hostilities  begin.  The  mission  of  the  JTF  is  to  halt  the  advance  of  the  threat  units  forward  of 
the  aerial  and  sea  points  of  debarkation  and  set  the  conditions  for  success  for  follow-on  forces. 


1.3  Purpose 


The  Value  Added  Analysis  framework  consists  of  the  following  modules:  issue  definition, 
effectiveness,  cost,  and  optimization.  The  purpose  of  this  effort  is  to  generate  and  provide 
combat-effectiveness  and  cost  estimate  data,  and  using  optimization  formulation  to  determine 
investment  strategies.  The  end  result  will  be  used  as  a  tool  in  the  analysis  that  goes  into  the 
decision  making  process  for  Program  Objective  Memorandum  (POM)  04-09. 
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1.4  Key  Assumptions 


The  key  assumptions  for  VAA  QVEX  are: 

(1)  Combat  simulations  are  an  appropriate  means  of  measuring  weapon  system  combat 
effectiveness. 

(2)  The  Measure  of  Effectiveness  (MOE)  (which  is  the  Fractional  Exchange  Ratio  -  FER) 
properly  depicts  the  effectiveness  of  each  weapon  system.  We  use  tanks,  anti-tank 
vehicles,  helicopters,  and  artillery  (TAHA)  when  detennining  the  FER. 

(3)  The  TRADOC  SWA  8.0  scenario  is  appropriate  to  evaluate  the  weapon  systems  under 
consideration.  The  scenario  properly  stresses  the  systems  being  analyzed  to  show  how 
effective  the  systems  actually  are. 


1.5  Key  Limitations 


The  key  limitations  for  VAA  QVEX  are: 

(1)  Only  one  scenario  and  one  timeframe  are  explicitly  modeled. 

(2)  Not  all  procurement  programs  are  analyzed  because  of  a  limitation  of  the  corps  combat 
model  (Vector  In  Commander  -  VIC).  VIC  has  a  weakness  in  that  it  does  not  model 
Combat  Support  and  Service  Support  well.  The  model  focuses  on  the  combat  ability  of 
systems.  Because  VIC  is  corps  level,  theater  assets  are  not  simulated  well.  This  is 
evident  when  trying  to  simulate  theater  air  defense  systems  -  VIC  is  not  a  good  tool  to 
show  the  effectiveness  of  these  systems. 

(3)  Deployability,  effects  of  training,  and  other  readiness  issues  are  not  modeled. 
Deployability  is  not  modeled  in  VIC  -  the  game  turns  on  and  the  units  are  ready  to  fight 
(units  can  be  delayed  in  entering  the  simulation,  but  once  in  -  units  are  prepared  to  fight). 
The  simulation  is  very  sterile;  all  units  with  the  same  TOE  have  the  same  ability,  all  units 
ready  to  fight  when  simulation  starts.  VIC  does  not  take  training  into  account  (Infantry 
Battalion  A  will  be  just  as  effective  as  Infantry  Battalion  B). 

(4)  Cost  data  is  received  from  the  Army  Cost  and  Economic  Analysis  Center  (CEAC).  A 
shortcoming  is  that  it  does  not  provide  O&M  cost  for  all  systems  -  particularly  for  new 
and  future  systems  that  do  not  have  data  to  support  the  O&M  cost.  This  is  an  issue  we 
are  attempting  to  fix. 

1.6  Scope 


The  scope  of  this  report  includes  the  7  weapon  systems  presented  in  Figure  1 .  The  sponsor  of 
the  project,  the  Army  G8,  detennined  what  Army  weapon  systems  to  include  in  QVEX.  This 
report  provides  a  comparison  of  the  base  systems  as  they  compare  to  their  modern  counterparts. 
This  analysis  includes  emphasis  on  munitions  and  on  weapon  system  comparison.  For  this 
study,  only  the  effectiveness  module  of  the  VAA  methodology  was  used. 
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Base  Case  Ammo  Near  Term  (2010)  Ammo 


1 

AH-64D 

RAH-66 

Paladin 

DPICM 

Paladin  Selective  Upgrade 

LCCM,  Excalibur 

M198 

DPICM,  HE 

HIMARS 

MLRS 

M270A1 

I, la, II  (Ammo  A) 

MLRS  M270A1 

I,Ia,II,Iia,  GMLRS, 
MSTAR  (Ammo  B) 

M1A1 

MlA2Sep 

TERM 

Bradley  M2A3 

Bradley  ODS 

Common  Missile 

7 

TOW  II  F&F 

LOSAT 

1 


Figure  1.  Weapon  Systems  Analyzed 


Also  analyzed  are  the  interactions  between  two  systems.  VAA  identifies  and  analyzes  all 
interactions  between  two  systems.  That  interaction  may  include: 


(1)  Sensor  and  shooter. 

(2)  Direct  and  indirect  fire  systems. 

(3)  Two  indirect  fire  systems. 

(4)  Two  direct  fire  systems. 


These  interactions  can  be  synergistic,  anergistic,  or  negligible.  Interactions  between  3  or  more 
weapon  systems  are  not  analyzed  due  to  time  and  resource  constraints. 
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2  METHODOLOGY 


Figure  2.  VAA  Methodology 

Figure  2  provides  the  framework  of  the  Value  Added  Analysis  (VAA)  methodology.  The  VAA 
methodology  was  developed  in  the  late  1980s  to  address  the  problem  of  cross-mission-area 
tradeoffs  between  modernization  programs.  It  consists  of  a  series  of  sub-analyses  integrated  into 
a  methodology  that  culminates  in  the  generation  of  recommended  acquisition  strategies.  The 
conduct  of  a  VAA  study  typically  consists  of  an  initial  long-term  project  followed  by  a  series  of 
quick-reaction  analyses.  The  long-term  project  is  designed  to  develop  the  cost  and  effectiveness 
information  necessary  to  support  the  analysis  of  the  issues  in  the  current  Program  Objective 
Memorandum  (POM)  decision  cycle.  The  follow-on  quick-reaction  analyses  then  address 
specific  questions  and  concerns.  This  report  will  discuss  the  long-tenn  portion  of  the  analysis. 


QVEX 
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2.2  Issue  Definition  Module 


Issue  Definition  Module 

□  What  are  the  cost  and  benefits  of  the... 

•  Comanche  compared  to  the  Apache? 

•  Paladin  Upgrade  compared  to  the  Paladin? 

•  HIMARS  compared  to  the  M198? 


Issue  Definition 
Module 


Effectiveness  Module 


( XUV'ijoiti  Huffmninainiiat 


Design  of  Experiments 


Optimization 

Module 


Sensitivity  ^  — 

Analysis  ™  1 - 1 


MSTAR  compared  to  I,  la,  and  II  MLRS  Ammo? 
LOSAT  compared  to  the  TOW  II  Fire  &Forget? 
M1A2Sep  compared  to  the  M1A1? 

Bradley  ODS  compared  to  the  Bradley  M2A3? 


□  What  is  the  effect  of  bad  weather  in  the  SWA  scenario  on  the 
measures  of  effectiveness? 


□  What  are  the  synergies  between  systems  in  the  SWA  scenario? 

□  What  are  some  good  system  investment  strategies  based  upon 
the  SWA  scenarios? 


Figure  3.  Issue  Definition  Module 

The  VAA  procedure  begins  with  the  determination  of  the  systems  to  be  addressed  in  the  current 
iteration  of  VAA.  This  list  is  developed  in  conjunction  with  the  study  sponsor.  Figure  3 
addresses  questions  that  the  sponsor  requested  to  be  analyzed.  The  issue  definition  module 
requires  that  the  problem  be  defined  and  its  associated  elements  be  studied  so  that  the  data 
collection  and  analysis  efforts  can  be  focused  upon  the  questions  and  issues  of  interest  to 
decision  makers.  The  general  context  of  the  study  in  terms  of  systems  and  programs  to  be 
analyzed  is  established,  along  with  timeframes  and  scenarios  of  interest. 


Figure  1  provides  the  list  of  systems  and  munitions  that  were  analyzed. 
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2.3  Effectiveness  Module 


Using  Vector-In-Commander  (VIC) 
as  the  corps-level  combat 
simulation,  the  relative  contribution 
of  systems  to  combat  effectiveness 
is  determined. 

Using  experimental  design 
techniques,  data  is  collected  from 
the  simulation  runs  and  the 
contribution  of  each  of  the 
evaluated  systems  to  the  measures 
of  effectiveness  is  calculated. 


Figure  4.  Effectiveness  Module 

The  purpose  of  this  effort  is  to  generate  and  provide  combat  effectiveness  data  for  input  into  the 
VAA  process.  The  modeling  and  analysis  effort  for  the  effectiveness  module  uses  the  Vector  In 
Commander  (VIC)  model  with  a  TRADOC  approved  Southwest  Asia  (SWA)  scenario  in  a  32- 
run  design  of  experiment  to  calculate  loss  and  force  exchange  ratios.  These  ratios  form  the  main 
inputs  into  the  effectiveness  module  of  the  VAA  process. 

The  effectiveness  module  is  the  most  time/resource  intensive  module  in  the  analytical 
framework.  The  end  result  of  this  portion  of  the  process  is  to  generate  the  objective  function  for 
the  mixed  integer  optimization  program  in  the  final  section  of  the  methodology.  The  first  step  in 
this  module  is  to  detennine  the  design  of  experiment.  The  design  of  experiment  was  built  to 
address  the  need  to  support  a  hypothesized  set  of  predictor  variables. 

The  run  matrix  of  the  design  of  experiment  was  created  to  support  analysis  of  the  seven 
treatment  factors,  named  Helo,  Tank,  IFV,  Rkt  Arty,  SP  Arty,  Paladin,  and  Missile  in  the  context 
of  least  squares  regression  analysis.  This  regression  model  in  generic  form  is: 

m 

y,  =«  +  XAv,  +c 

j= i 
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where  i  represents  the  observation  number.  The  st  are  modeled  as  statistically  independent  of 
the  x’s  and  each  other,  and  randomly  distributed  according  to  a  normal  distribution  with  mean 
zero  and  variance  cr2.  Under  these  assumptions,  the  regression  coefficients  are  to  be  taken  as 
unbiased  indications  of  the  effect  of  different  equipment  trades,  but  they  are  subject  to  estimation 
error  due  to  sampling. 

The  design  matrix  (Figure  6)  is  a  fractional  factorial  design,  in  which  all  combinations  of  the 
seven  factors  define  the  16  runs.  The  design  matrix  is  balanced  with  respect  to  the  hypothesized 
effects,  and  none  of  these  hypothesized  interaction  effects  are  confounded  or  aliased.  The  matrix 
is  chosen  so  that  any  two  of  the  variables  or  products  in  the  equation  are  uncorrelated  and  have  a 
mean  of  zero.  For  example,  if  one  forms  the  products  of  AH-64Dj  with  HIMARS*MlA2Sepj 
their  sum  will  be  zero  over  the  experimental  design.  A  consequence  of  this  lack  of  correlation  is 
that,  for  each  of  the  levels  of  term  A,  the  average  value  of  tenn  B  is  zero.  This  implies  that  MOE 
differences  between  the  levels  of  A  as  seen  in  the  raw  data  are  unaffected  by  the  value  taken  by 
the  coefficient  for  any  term,  B.  Because  of  this  property,  difference  in  the  means  of  treatment 
groups  are  not  misleading  in  view  of  the  other  treatment  effects  or  interactions  as  long  as  these 
are  among  the  hypothesized  set.  The  regression  coefficients  will  be  exactly  one-half  of  the 
observed  differences. 

VIC  is  a  two-sided,  deterministic,  discrete-event  simulation  of  combat  in  a  combined  arms 
environment  representing  land  and  air  forces  at  the  U.S.  Army  corps  level  with  a  commensurate 
enemy  force  in  a  mid-intensity  battle.  The  model  is  variable  resolution,  portrays  non-linear 
warfare,  represents  all  air  land  battle  functions,  and  has  been  verified  and  validated  by  TRADOC 
schools  and  centers.  The  model  is  designed  to  provide  a  balanced  representation  of  major  force 
elements  in  a  tactical  campaign  of  a  U.S.  Army  corps  operating  in  a  Theater  of  Operations. 
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□  Conduct  base  case  runs  to  obtain  consistent  MOEs. 

□  Conduct  switch  analysis  runs  to  test  “value  added”  effect  of  new 
weapon  systems. 

•  One  at  at  a  time  replacement  for  all  systems. 

•  Modify  technical  and  operational  data  sets  so  the  scenario 
results  are  credible. 

□  Conduct  demonstration  case  runs  IAW  experimental  design. 

•  32  runs  -  combination  of  base  systems  and  modern  systems. 

•  Modify  technical  and  operational  data  sets  so  the  scenario 
results  are  credible. 

•  Identify  ammunition  contribution  to  system  effectiveness. 


Figure  5.  Design  Methodology 

The  design  methodology  used  for  the  effectiveness  module  is  listed  in  Figure  6\5.  A  three-step 
process  was  used  as  it  pertained  to  VIC  runs. 

Step  one  was  to  conduct  the  base  case  runs.  After  we  were  comfortable  with  the  base  runs  (flow 
of  the  battle  with  the  base  systems)  we  conducted  switch  analysis.  A  modern  system  was 
substituted  for  a  base  system  in  VIC  to  determine  if  the  data  for  the  modern  system  enabled  the 
system  to  perfonn  as  one  would  expect  it  to  perform.  This  was  done  for  each  modernized 
system.  Analysis  was  conducted  on  each  of  these  runs  to  ensure  the  modernized  systems 
performed  as  one  would  expect.  If  there  were  any  questions  reference  the  performance  of  the 
modernized  system  more  analysis  was  conducted  to  determine  if  there  were  flaws  in  any  of  the 
data.  Once  we  were  satisfied  with  the  base  case/switch  analysis,  we  then  conducted  the  design  of 
experiment  (DOE)  runs. 

The  Loss  Exchange  Ratio  (LER)  is  the  ratio  of  Red  losses  divided  by  Blue  losses.  Fractional 
Exchange  Ratio  (FER)  is  an  indication  of  the  likelihood  that  the  Blue  force  wins  or  loses  by 
measuring  the  fractional  Red  losses  divided  by  fractional  Blue  losses,  normalized  for  the  size  of 
each  force.  The  data  used  in  the  LER/FER  calculation  was  computed  from  the  model’s  record  of 
killer- victim  interactions  (the  “Record  1”  file  from  VIC  output).  These  files  were  filtered  in  a 
controlled  and  auditable  manner  using  the  “SAS”  statistical  package.  Thus  the  LER  and  FER 
were  calculated  directly  from  source  data  using  an  automated  filtering  mechanism. 
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Figure  6.  Design  of  Experiment 

The  design  of  experiments  was  determined  using  a  Fractional  Factorial  design  (Figure  6).  We 
desire  to  detennine  the  combat  contribution  of  each  weapon  system  to  the  outcome  of  the  battle 
as  measured  by  the  combat  effectiveness  MOE.  A  common  method  of  accomplishing  this  task  is 
to  establish  a  baseline  case,  which  includes  no  new  system,  then  to  add  or  substitute  each  new 
weapon  system  one  at  a  time,  measuring  the  changes  in  combat  effectiveness.  These  changes 
from  the  baseline  case  measure  the  contribution  of  a  weapon  system.  While  this  method 
measures  the  contribution  of  each  individual  system,  it  does  not  directly  allow  for  the 
determination  of  the  combined  effect  of  weapon  systems  mixes,  i.e.,  if  an  attack  helicopter  raises 
the  value  of  an  MOE  by  x  and  a  tank  raises  the  value  by  y  as  individual  substitutions,  then  it  is 
often  not  true  that  if  both  systems  are  present,  the  resulting  improvement  would  be  x  +  y ;  it  may 
be  lower  or  higher. 

The  ideal  method  of  detennining  the  optimal  mix  of  new  weapon  systems  would  be  to  explore  all 
possible  combinations.  This  method  would  find  the  combination  of  systems  that  yields  the 
greatest  increase  in  the  MOE  values.  While  this  method  is  practical  for  situations  where  the 
number  of  systems  to  be  evaluated  is  small,  the  number  of  combinations  grows  quickly  as  the 
number  of  such  systems  increases.  For  three  systems,  there  are  23,  or  eight  combinations.  If  one 
had  to  explore  every  combination  of  39  different  systems,  the  number  of  potential  runs  would  be 
239,  or  about  5.5  billion  runs. 
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Response  Surface  Methodology  (RSM)  represents  a  compromise  between  the  process  of 
replacing  weapons  one  at  a  time  and  the  ideal  solution  of  examining  every  combination.  This 
compromise  is  known  as  a  fractional  design,  meaning  that  a  specific  subset  of  the  combinations 
is  used.  The  subset  of  combinations  of  systems  to  be  examined  is  detennined  using  a  particular 
experimental  design.  The  resulting  “design  matrix”  varies  the  combinations  in  an  efficient 
manner  so  that  a  general  linear  model  can  be  built  to  forecast  the  effects  of  the  systems  with 
respect  to  the  outputs.  A  set  of  coefficients  is  computed  which  is  the  mean  or  average 
combination  of  the  new  weapon  system.  These  coefficients  can  then  be  used  in  an  additive 
estimate. 

Fractional  Factorial  designs  are  useful  when  the  problem  of  determining  the  main  effects  with 
maximum  precision  is  reduced  to  a  combinatorial  problem.  They  are  useful  when  the  problem 
has  only  two  level  factors,  i.e.,  when  there  are  low  and  high  variable  settings  or  binary  (0,  1) 
variables.  In  VAA,  the  systems  being  considered  for  procurement  are  the  “factors”.  A  “1” 
represents  the  presence,  in  the  appropriate  quantities  for  the  modeled  force  structure,  in  the 
excursion.  A  “-1”  indicates  that  the  Base  Case  Systems  are  played  in  that  excursion. 


The  DOE  was  made  up  of  direct  fire  systems,  indirect  fire  systems,  and  munitions.  This 
straightforward  design  clarifies  in  understanding  scenario  dynamics  and  exactly  how  these 
systems  stack  up  against  one  another. 

The  overall  results  from  the  VIC  runs  concluded  that  the  MSTAR  fired  from  the  MLRS  M270A1 
dominate  the  killing.  Other  artillery  systems  kill  the  next  most  (HIMARS  being  the  primary 
contributor).  At  the  final  stages  of  the  battle,  it  was  noticed  that  tanks  (and  LOSAT)  playing 
some  sort  of  “shock  absorbing”  role  that  seems  to  react  to  the  effectiveness  of  the  other  systems. 

This  scenario  coupled  with  this  DOE  provides  clear  insight  into  the  way  the  combined-arms  fight 
is  supposed  to  work  in  the  real  world.  The  dynamics  between  the  four  shooters  (HIMARS, 
MLRS,  helicopters,  tanks)  demonstrate  killing  at  a  distance  in  a  coordinated  fashion,  which  was 
then  followed  up  with  the  close-in  fight. 

Modernizing  every  system  with  precision  munitions  does  not  always  have  a  synergistic  effect, 
especially  when  munition  ranges  overlap  and  there  is  limited  target  array.  Having  a  balance  of 
precision  and  non-precision  capabilities  results  in  more  enemy  kills  in  this  scenario. 
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Figure  7.  Increase  in  Fractional  Exchange  Ratio 

After  completion  of  the  DOE  runs,  analysis  was  conducted  to  determine  the  fractional  exchange 
ratio  for  each  run.  Regression  analysis  was  then  conducted  on  each  run  to  determine  the  percent 
increase  for  each  modem  system.  Figure  7  represents  the  percent  increase  as  it  pertains  to  the 
fractional  exchange  ratio  for  the  modern  systems  compared  to  the  base  systems. 
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2.4  Cost  Module 


Cost  Module 
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□  Life  cycle  costs  are  estimated  using  the  most  accurate  data 
available  from  the  Army  Cost  and  Economic  Analysis  Center 
(CEAC). 


□  Life  cycle  costs  included: 

•  Research,  development,  test,  and  evaluation  (RDT&E) 
costs. 

•  Fixed  production  costs. 

•  Variable  production  costs,  to  include  learning  curve 
effects. 

•  Operations  and  maintenance  costs. 


□  The  annual  RDA  appropriation  is  estimated  from  a  base 
planning  document  and  used  to  constrain  procurement 
expenditures  for  a  given  year. 


Figure  8.  Cost  Module 

The  purpose  for  the  cost  module  is  twofold.  First,  accurate  system  procurement  costs  must  be 
estimated,  including  research,  development,  test  and  evaluation  (RDT&E)  costs;  fixed 
production  costs;  and  variable  production  costs.  These  costs  are  necessary  for  conducting  the 
optimization  that  finds  the  mix  of  systems  that  maximizes  the  effectiveness  of  the  force  subject 
to  constraints  on  the  Research,  Development,  and  Acquisition  (RDA)  budget.  Second,  given 
optimization  quantities  of  procured  systems,  estimates  must  be  computed  of  the  other  aspects  of 
the  life  cycle  costs  of  the  system.  These  aspects  include  fielding  costs,  containment  costs,  and 
facilities  costs.  Once  the  various  components  of  the  life  cycle  costs  are  computed,  they  must  be 
made  available  in  an  easily  accessible  form  so  that  information  regarding  the  costs  of  the  modern 
systems  can  be  analyzed. 

An  important  aspect  of  estimating  the  procurement  costs  associated  with  the  modem  systems  is 
determining  whether  or  not  a  significant  relationship  exists  between  the  unit  cost  of  a  system  and 
the  quantity  procured.  For  many  of  the  modern  systems,  particularly  the  developmental  systems 
that  involve  new  technology  (such  as  the  RAH66  Comanche),  this  cost-quantity  relation  is 
significant  and  nonlinear.  As  such,  this  relationship  must  be  considered  and  accounted  for,  to 
ensure  accurate  results.  For  the  purposes  of  this  study,  the  cost-quantity  relationship  reflects 
economies  of  scale  in  terms  of  materials  and  labor,  as  well  as  “learning”  on  the  part  of 
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production  labor  force.  The  Army  Cost  and  Economic  Analysis  Center  generated  the  cost  data 
that  included  the  following: 

1.0  -  Total  RDT&E  by  year  cost  in  same  year  constant  dollar; 

2.0  -  By  year  cost  in  same  year  constant  dollar  spread  by  year  for  each 
sub-element  (2.01  to  2.14)  production  quantity  by  year;  and, 

5.0  -  Total  OMA  by  year  cost  in  same  year  constant  dollar,  and  breakout  by: 

*  5.03  -  Consumables 

*  5.04  -  Reparables 

*  5.05  -  POL 


Cost  estimates  are  completed  for  each  modern  system.  The  effectiveness  per  system  (percent 
increase  in  FER)  is  then  divided  by  the  cost  per  system  to  detennine  the  “Benefit-Cost  Ratio”. 
The  phrase  “Most  Bang  for  the  Buck”  is  often  used  for  this  outcome.  One  must  understand  that 
the  results  are  for  a  certain  scenario  and  may  change  in  a  different  setting/scenario.  The  cost 
module  was  not  used  in  this  study. 
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2.5  Optimization  Module 


Optimization  Module 


□  System  effectiveness  and  costs  are  inputs 
for  a  mathematical  optimization  model  that 
develops  investment  strategies: 

•  Investment  strategies  are  affordable, 
feasible  program  alternatives  of  what 
systems  to  buy,  when  to  buy  them,  and 
how  many  to  buy. 


□  The  results  are  feasible  because 
production  limitations  and  budget 
constraints  are  met. 


Figure  9.  Optimization  Module 

The  optimization  module  generates  several  acquisition  strategies  for  the  systems  under 
consideration.  This  acquisition  strategy  is  obtained  from  a  mixed  integer,  linear  programming 
optimization  model,  with  the  objective  of  maximizing  the  total  effectiveness  of  the  Army,  as 
generated  in  the  effectiveness  module  discussed  earlier.  This  objective  is  constrained  to  meet  the 
requirements  of  staying  within  the  total  obligation  authority  allocated  to  the  systems  under 
consideration,  meeting  the  fielding  goals  obtained  from  the  Army  G8,  staying  within  the  ability 
of  the  production  lines  to  produce  the  equipment,  and  finally  taking  any  industrial  base  concerns 
into  consideration. 


There  are  several  variables  that  are  fed  into  the  optimization  module.  The  following  provides  the 
variables  with  definition: 


Fixed  Costs:  Any  cost  that  is  incurred  by  a  program  that  is  not  related  to  the  quantity  of  the  item 
produced  is  designated  a  fixed  cost.  The  model  considers  two  such  categories  of  cost.  The  first 
is  Research,  Development,  Test,  and  Evaluation  (RDTE)  costs.  These  costs  are  typically 
incurred  during  the  POM  period,  and,  as  the  name  implies,  pay  for  many  of  the  developmental 
aspects  of  the  procurement  programs.  The  other  category  is  that  of  fixed  production  costs. 
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These  costs  are  incurred  just  prior  to,  and  early  in  the  production  phase  of  the  funding  profile  for 
the  programs.  These  costs  are  incurred  irrespective  of  the  quantity  produced.  Any  line  closing 
costs  at  the  conclusion  of  the  production  of  the  program  are  also  represented  as  fixed  costs.  All 
of  the  fixed  costs  are  summed  for  each  year  and  are  assessed  against  the  program  if  the  program 
is  selected  for  funding. 

Variable  Production  Costs:  The  costs  associated  with  the  production  of  an  individual  item  are 
designated  as  variable  costs.  These  costs  are  also  represented  in  two  ways.  The  first  concerns 
items  for  which  there  is  no  change  in  the  cost  as  a  function  of  the  quantity  produced.  This  means 
there  is  no  learning  behavior  that  is  identifiable  in  the  per-unit  of  the  item  for  the  entire  cost,  or 
for  some  component  of  the  cost.  In  this  case,  an  average  unit  cost  is  given  and  is  assessed  for 
each  item  produced.  The  second  concerns  items  that  do  exhibit  an  identifiable  learning  behavior 
in  their  variable  costs. 

Force  Structure  Requirements:  Force  structure  requirements  drive  the  decisions  regarding  how 
many  of  a  particular  item  of  equipment  should  be  procured.  For  each  candidate  program,  the 
study  sponsor  must  specify  the  level  of  force  structure  that  is  to  be  modernized  with  the 
candidate  system.  The  specification  might  be  in  tenns  of  force  packages  to  be  modernized,  in 
terms  of  some  other  grouping  of  units,  or  as  a  total  number  of  items  to  be  procured.  Often  the 
sponsor  will  specify  the  exact  program  with  respect  to  the  years  of  procurement  and  the  yearly 
procurement  quantities.  The  optimization  model  is  flexible  enough  to  handle  any  of  these 
methods  of  specifying  total  required  quantities  for  the  candidate  systems. 

Production  Limitations:  An  important  aspect  of  the  VAA  methodology  is  the  computation  of  a 
feasible  acquisition  strategy  for  each  of  the  funded  candidate/modernized  systems.  To  ensure 
feasibility,  the  ability  of  industry  to  produce  the  specified  quantity  in  each  year  of  the  production 
campaign  of  each  funded  program  is  accounted.  Thus,  the  yearly  production  quantities  must  be 
constrained  to  be  between  the  minimum  sustaining  rate  of  production  and  the  maximum 
production  rate  of  production.  These  values  which  are  provided  as  data  represent  the  output  of 
one  8-hour  shift  and  three  8-hour  shifts,  respectively,  of  the  specified  production  facility  for  the 
given  candidate  system.  Additionally,  initial  quantities  are  often  ramped  up  in  the  early  years  of 
production.  These  restrictions  are  handled  in  the  same  way  as  the  other  production  constraints. 
Finally,  a  fairly  smooth  production  campaign  is  usually  desirable.  This  means  that  large  swings 
in  yearly  production  quantities  cannot  be  pennitted.  So  limits  must  be  placed  on  the  quantities 
such  that  the  procurement  quantity  for  a  system  in  one  year  must  not  vary  from  the  previous 
year’s  quantity  by  more  than  some  allowable  percentage.  This  percentage  is  specified  as  input 
data  to  the  optimization  program.  Note  that  cost  analysis  estimates  are  made  with  respect  to  a 
particular  production  facility,  and  departures  from  the  specified  set  of  facilities  would  result  in 
the  need  to  reevaluate  the  program.  Note  also  that  when  the  sponsor  specifies  the  program  with 
respect  to  both  the  quantities  and  the  years  of  procurement,  both  the  upper  and  lower  production 
limits  are  set  to  the  given  yearly  quantity  values,  ensuring  that  quantities  procured  match  the 
sponsor’s  decision.  The  total  quantity  to  be  procured  must  match  the  force  structure  requirement 
values  or  infeasibility  will  result. 

For  this  study  the  optimization  module  was  not  used  do  to  the  analysis  required  by  the  sponsor. 
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2.6  Resources 


□  Vector-In-Commander  (TRAC-FLVN), 
Corps  Level  combat  simulation. 

□  Continued  funding  for  the  contractor  to 
perform  combat  simulation  support  to 
model  scenarios. 

□  CEAC/CAA  cost  data  support. 


Figure  10.  Resources 

Resources  from  outside  of  the  Center  for  Army  Analysis  that  were  required  to  conduct  VAA  are 
listed  in  Figure  10.  Without  these  resources  this  study  would  not  have  been  accomplished  in  the 
allotted  time.  By  receiving  the  scenario,  model  and  data  from  the  TRADOC  Analysis  Center, 
Fort  Leavenworth,  we  saved  approximately  one  year  of  time/effort.  This  enabled  the  quick  turn¬ 
around  of  analysis. 

Northrop  Grumman  provided  a  team  that  set  up  and  conducted  all  the  VIC  runs.  They  also 
played  a  major  role  in  conducting  the  analysis  for  this  project. 

Cost  estimates  for  each  system  were  provided  by  the  Army  Cost  and  Economic  Analysis 
Center  (CEAC). 
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3  SUMMARY  AND  CONCLUSIONS 


3.1  Summary  and  Conclusions 


The  use  of  Value  Added  Analysis  provides  decision  makers  at  the  Department  of  Army  level 
with  a  tool  to  quickly  evaluate  programming  and  budgeting  decisions  in  the  area  of  system 
modernization. 

The  primary  killer  on  the  battlefield  is  the  MLRS  firing  the  MSTAR  munition.  The  MSTAR 
munition  is  used  in  the  deep  fight.  The  close-in  fight  is  left  to  the  tanks,  which  perform 
admirably  by  eliminating  enemy  tank,  artillery,  helicopter,  and  anti-tank  (TAHA)  systems  that 
remain. 

HIMARS  performs  significantly  better  than  the  Ml 98  resulting  in  more  red  system  kills  and 
fewer  blue  system  losses.  Modernizing  every  system  with  precision  munitions  does  not  always 
have  a  synergistic  effect,  especially  when  munition  ranges  overlap  and  there  is  a  limited  target 
array.  Having  a  balance  of  precision  and  non-precision  capabilities  results  in  more  enemy  kills 
in  the  SWA  scenario. 

Value  Added  Analysis  provides  rigorous  analysis  that  supports  the  Army’s  modernization 
system.  It  has  limitations,  mainly  that  it  does  not  cover  all  systems.  VAA  provides  insights  into 
modernization  issues  and  provides  viable,  defendable  options  useable  by  the  Anny  leadership  as 
a  valuable  tool  in  the  decision  making  process. 
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APPENDIX  A  PROJECT  CONTRIBUTORS 

1.  PROJECT  TEAM 

a.  Project  Director: 

LTC  A1  East,  Resource  Analysis  Division 

b.  Team  Members: 

c.  Other  Contributors: 

LTC  John  Gregory  Heck,  Documentation 

2.  PRODUCT  REVIEWERS 

Dr.  Ralph  E.  Johnson,  Quality  Assurance 

3.  EXTERNAL  CONTRIBUTORS  (If  any) 

Northrop  Grumman  Infonnation  Technology 
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APPENDIX  B  REQUEST  FOR  ANALYTICAL  SUPPORT 


Performing  Division:  RA  Account  Number:  2001165 

Acronym:  QVNEA  Mode  (Contract-Yes/No):  In-house 

Title:  Value  Added  Analysis  NEA 

Start  Date:  09-Jul-01  Estimated  Completion  Date:  31  -Oct-01 

Requestor/Sponsor  (i.e.,  DCSOPS):  DCSPRO  Sponsor  Division:  FD 

Resource  Estimates:  a.  Estimated  PSM:  24  b.  Estimated  Funds:  $0.00 

c.  Models  to  be  Used:  VIC  &  VAA  optimizer 
Description/Abstract: 

Provide  decision  makers  an  analytical  approach  for  the  evaluation  and  prioritization  of  competing 
alternatives  to  support  the  development  of  a  balanced  and  effective  Army  research,  development, 
and  acquisition  (RDA)  program.  Analyze  different  modernization  alternatives  for  the  QDR  and 
POM  and  compare  them  to  a  baseline  of  Army  systems  with  respect  to  cost,  effectiveness,  and 
other  measures  using  a  Northeast  Asia  corps-level  scenario. 

Study  Director/POC  Signature:  Phone#:  703-806-5391 

Study  Director/POC:  LTC  A1  East 

P  Background: 

A  Headquarters,  Department  of  the  Army  (HQDA)  requires  analysis  to  support  the  development  of  a 
balanced  and  effective  modernization  program.  Value  Added  Analysis  (VAA)  analyzes  benefits 
and  costs  among  different  weapon  systems  and  munitions. 

R 

T  Scope:  Northeast  Asia  (NEA)  scenario  using  Vector- In-Commander  corps-level  combat  simulation 
for  the  combat  effectiveness  module. 

2 

Issues:  Selecting  appropriate  weapon  systems  for  analysis;  identifying  relevant  measures  of 
effectiveness;  determining  optimal  investments  strategies. 

Milestones:  Completion  of  combat  effectiveness,  cost,  and  optimization  modules. 

Signatures  Division  Chief  Signature:  Date:  Signed  and  Dated 

Division  Chief  Concurrence:  Signed  and  Dated 
Sponsor  Signature:  Signed  and  Dated 

Sponsor  Concurrence  (COL/DA  Div  Chief/GO/SES)  :  Signed  and  Dated 
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APPENDIX  C  GLOSSARY 

ABBREVIATIONS,  ACRONYMS,  AND  SHORT  TERMS 


ACS 

ATACMS 

CAA 

CEAC 

CGS 

DCGS 

DOE 

DPICM 

FER 

HE 

HIMARS 

JLENS 

LCCM 

LER 

MlA2Sep 

MLRS 

MSTAR 

MOE 

NEA 

OMA 

PGMM 

POL 

POM 

RDA 

RDT&E 

SWA 

TAHA 


Aerial  Common  Sensor 

Army  Tactical  Missile  System 

Center  for  Army  Analysis 

U.S.  Army  Cost  and  Economic  Analysis  Center 

Common  Ground  System 

Distributed  Common  Ground  System 

Design  of  Experiments 

Dual-Purpose  Improved  Conventional  Munitions 
Fractional  Exchange  Ratio 
High  Explosive 

High  Mobility  Artillery  Rocket  System 

Joint  Land  Cruise  Missile  Defense  Elevated  Netted  Sensors  System 
Low  Cost  Competent  Munitions 
Lost  Exchange  Ratio 

M1A2  Abrams  Main  Battle  Tank  Systems  Enhanced  Package 

Multiple  Launch  Rocket  System 

MLRS  Smart  Tactical  Rocket 

Measure  Of  Effectiveness 

North  East  Asia 

Operations  &  Maintenance,  Army 
Precision  Guided  Mortar  Munition 
Petroleum,  Oil,  Lubricants 
Program  Objective  Memorandum 
Research,  Development,  Acquisition 
Research,  Development,  Test,  and  Evaluation 
South  West  Asia 

Tanks,  Anti-tank  vehicles,  Helicopters,  Artillery 
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TRAC 

TRAC  FLVN 

TRADOC 

TUAV 

UAV 

VAA 

VIC 


TRADOC  Analysis  Center 

TRADOC  Analysis  Center  Fort  Leavenworth 

Training  And  Doctrine  Command 

Tactical  Unmanned  Aerial  Vehicle 

Unmanned  Aerial  Vehicle 

Value  Added  Analysis 

Vector  In  Command 
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Short  Title 
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